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BACKGROUND 

environment, many users store data and p gr 

computer server storage subsystem of J 
induding hard disk drives, tape drives, eompaet dtsc (CD) dnves, gr 



drives, and so forth. 



rr— — — — :-=r^ 

may not be abie to offer reliabie performance at very htgh operatmg 

jsssssrsr 

(SAS) Standard has been proposed. The SAS Stan 
LormarionbetweenSCSfd^^ 

Revision 5, dated July 9, 2003. 

[004] One feature of a SAS system e that include one or more expanders. An 

— — ^rB^rJeoup.Loomere.pandersto 
further expand the ^ associated with one or more initiators. An initiator 

domain to retrieve data or to write data. 
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,H SASStandard for initiators in different SAS expander domains to 
[0051 Accord.ngto.he SAS Standard c _ica,ions"), interfaces 

comm unicate with each other (referred to as utter ™ ' 

^vailable for coupling to other devtces m a SAS expan 
or expanders. 

[oo6] F ,, A J!^o^^ 
t r h edS m anCo m puterS yS te ml nterface(SAS)storagedevtce, 

[007] Flg , 2A ,Careahloc k diagramofco m poneu,sofexpa n ders 1 uaSASstorage 
tree in the computer system of Fig. 1. 

expander domains. 

DETi^EDDESCRSTlON 
toFig s 1A-1B acomputersystemlOTaccordingtooneexample 

including a non-volatile memory 385. 

System Interface) controller 405 (Fig. IB). 

«• rt „faSASl/Osubsystem(identifiedbynumeral400rn 
[00111 This SAS controller 405 is part ° ^ J ^ t con forms with the SAS 
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tern interface) devices over a serial interconnect. SCSI devices include storage 
computer system mterface) ^ 
devices such as hard disk drives, compact dtsc (CD) » 
dnves, and other mass storage devices. In other embodtments, SCSI 
other types of peripheral devices. 

j v.. ir, thp SAS I/O subsystem 400 may be 

===== 

, mt the SAS contt oller 405 is implemented as an application-specrfic 
the correct destination through another port. 

====== -~r=52£- 

links 406a 406b, 406c, and 406d are shown. A phy accordmg to SAS typ y 
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in multiple storage trees 420, 400, <wo, 
storage tree 420 are labeled 416a and 416b. 

expander 430 and expander 435 are each turtn ^ 

bel0 w) that allows information reeetved by one port 
storage device through another port in the expander. 

. ftheSAS Standard does no. allow two SAS domains (expander 

ted r^I elanonec— .ion exists, loops may 
multiple paths to the same addresses and embodiments of th e invention, links 

-^ T0 — "arC — eenexpandersmmfferentSAS 

domains so that two or more rmhator a g shown in Fig. IB, an ICL 

eOO.noenah.ean— «^^^^"- 
intercontroller link marks one or more phy ^ ^ 

actions). For example, a 12 phy P ^ in me 

[OOt^u^gnowo^a 05i5aninitiatorttotg enera t esread/wn«e 
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n the CPU 310 (Fig. 1A) of computer system 107. In some 

ui 717s 91 7b 217c, and so 

. . 0 ,,j a 71 5b 215c, and so forth. A routing, 
fo ^forrespec«vephys2^ * • ^ of whichmay taclud e an 

includes expander route entnes 230a, , . .^.^ 

— - iebit22 r da ^ s i ^—tr te -^-.—-- 

to an initiator, expander, or storage dev, e ^ ;n ^ 

expander 410 is able to aecess each routtng table 217 to allocate 
in each of the routing tables as desired. 

utilized. Theenable,d,sableb,.220fo ith route toble enny mapptng 

(RTEM) logic issue S AS ^J°^| es j n the expander 410 during a computer system power- 
dynamically populate the J 400 „ modified (e , replacement of 
on sequence. If die configuration of VO V ^ ^ 

::rr;:::::rir— — — 

tables that are affected by the change. 

—""•'-•":r~:r 



expander 425. 
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A*r 425 (Fig 2B) The routing table for a phy with the 
perform information transfers. 

dir ec, aUribute rounng ph>. 215s, 2 , ^ ^ 215q> 215p , 
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Enable/ 
Disable 


SAS 
Address 


Bit 




Enable 


SD A 


Enable 


SDB 


Enable 


SDC 


Enable 


Expander 430 


Enable 


Expander 435 


Enable 


SDX 


Enable 


SD Y 


Enable 


SDZ 


Enable 


SD D 


Enable 


SD E 






Enable 


SDL 


Enable 


SD M 


Enable 


SDN 


Enable 


SDO 






Enable 


SD V 


Enable 


SD W 



Table 1: Routing Table for Expander Phy 215a 

[0027] Referring to Figs. 3A-3C, two SAS expander domains 51 1 and 522 are coupled 
through ICLs 535a and 535b to allow communication between initiators 515 and 520 in the 
respective SAS expander domains 511 and 522. The two expander domains 511 and 522 may 
be part of two different computer systems, or they may be part of one computer system. In 
another embodiment, additional SAS expander domains can be coupled by other ICLs. An 
initiator 515 may include a number of initiator phys (e.g., 4 phys), and the other initiator 520 

7 
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u t a TnWl The initiator 515 is coupled 
^ective,, »"^£^^ m >*««»"»»-<»"°+ 

— sw- ' 

number of phys. 

(Fig. 3B) that are at a lower level m the SAS expand _ . and SDF 

585g SDH 585h,..., and SDM 585m. 

™ sr. 

supporting more storage devices. 

«« s^h 536c and 536d connected to the ICLs 535a and 
535b are referred to as ICL ^ contain different routing information than a 
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:;r:ir^ 

a table routing attribute may have la ^ 
Tab,e3 (for routing table 539b associated with ICL pbys 536c and 536d). 



pEnable/ 


SAS 
Address 


Disable 


Bit 


Enable 


Expander B 


Enable 


Initiator 1 



Table 2: 



Routing Table 539a for ICL Phys 536a and 536b 



Enable/ 


SAS 
Address 


Disable 


Bit 


Enable 


Expander A 


Enable 


Initiator 0 



Table 3: Routing Table 539b for ICL Phys 536c and 536d 
„ nder525 and5 30isassociatedwi.hs.orage,suchasrespecdvenon-vola.ile 
[0033] Each expander 525 ana 3ju is 

529and531(eg read-only memory (ROM), flash memory, etc.), to store 
storage 529 and 531 (e.g., ^ bejng located m to 

formation to indicate me presence of ICL phys. A gh ^ 
expanders 525 and 530, me non-volatile storage 529 an 5 , p » b ^ „ in 



9 



Express Mail No: EL 990137361 US 

200300857-1 (HPC.0017US) 

information is provided in one or more p g 
the System Management Protocol (SMP). 

predefined address range. The 5>Mf p*B v ; 

whetherlCLphysarepresentinanexpander. IflCLphys 
software 502 populates routing tables for the ICL phy, 

k ' Tab.es2and3,.herouting B blesforICLphysarefilled W ithSAS 
[0036] As shown above m Tables 2 and 3, responding ICL. 

devices while being used as an ICL. 

-r:-:.:= ::;*"" 

ofstandardphysasdescribedmtheSAS Standard. Th ^ 

d ef ffi edbyd 1 eSASStandard,forbroadeas,toa„devKes»aSAS 

routing con.ro.ier does not broadcast the message to ICL phys. 

::r:— -norn.pb^dphyUUanlCLpby. 
U phys visible to the software 500. The ILL pny 
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t ri«n of 255) and counting down such that ICL phys have the 
the hexadecimal represents of 255) and g ^ 

higher numbers (FFh and lower), whde the non-ICL phys have 
zero). 

ta yet another embodiment, multiple ICLs are eonnee.ed at mulUple 



domains. 



mod u,es. Thesoflwarerounnes ««**«^ or control or computing devices. 

— °— — — 

machine-readable storage medta for stonng or 

(EEPROMs) and flash memories; magnetic disks such as ^^^^ ^ Instructions 
otbermagneflcmediainclndingtape; or optica, ^ ^ stored m 

thatnTakeupmev^ussorWarerounnesormodulesmmcv^o * 

r espec.ive storage modn.es. The instructions when executed byarespect. 
cause the system to perform programmed acts. 

l,«™«.,wi«.«».**— -• """""" 



